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Method and apparatus for management of communications over media of finite bandwidth 

Tu- : _ . . 



(57) The invention provides a method and appara- 
tus for management of communications over media of 
finite bandwidth. One embodiment of the invention 
allows management of communications comprising a 
plurality of data streams from a plurality of sources. One 
embodiment of the invention effectively quantifies and 
controls data streams comprising data transferred at 
either regular or irregular data rates. One embodiment 
of the invention provides for estimation of data rate 
needs, measurement and analysis of current and histor- 
ical data rate parameters, dynamic allocation of availa- 
ble bandwidth, and supports cooperation between data 
sources and destinations in the management proc- 
esses. 
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Description 



BACKGROUND OF THE INVENTION 
5 1 . FIELD OF THE INVENTION 

[0001] The invention relates generally to communication of information and, more particularly, to management of 
communication of information over media of finite bandwiath. 

[0002] Portions of the disclosure of this patent document contain material that is subject to copyright protection. 

w The copyright owner nas no objection to the facsimile reproduction by anyone of the patent document or the patent dis- 
closure as it appears in trie Patent and Trademark Office file or records, but otherwise reserves all copyright rights what- 
soever. Sun. Sun Microsystems, the Sun logo, Java, and all Java-based trademarks and logos are trademarks or 
registered trademarks of Sun Microsystems, Inc. in the United States and other countries. AH SPARC trademarks are 
used under license and are trademarks of SPARC International, Inc. in the United States and other countries. Products 

15 bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc. 



2. BACKGROUN D A=U 

[0003] The overa" oeHom-ance of a computing system having components that are physically separated from one 
20 another is often limbed oy the rate a- which information may be moved between the components. The communication 
media for transferrin-: irf 0 ma:>on between the components has a limit as to the amount of information that can be 
transferred over it m a qver amount of time. Tnis limit is referred to as the bandwidth of the communication media. This 
limit is, in some sense analogous to me maximum amount of water that can be pumped through a particular size of 
pipe in a given amount of time Wn.te water pumped through a pipe may be measured in gallons per minute, for exam- 
25 pie, the bandwidth of a commun cation medium is often expressed in bits per second, where each bit is a binary digit. 
A binary digit is a sman un«t of information that has either the value zero or the value one and from which other larger 
units of information may be const-ucred. 

[GCC4] Furthermore, jus: as a cacie television company may combine the signals from many television programs to 
be carried over one h.grvcapacrry cable, it is sometimes desirable to transmit information from multiple sources through 
30 a communication medium. In some configurations, multiple sources may transmit information to a single destination, for 
examole, a single user terminal. 

[0005] However, information passed between components of a computing system is often passed at an irregular 
rate. For example, much information might be transferred to send a document to a user terminal for display, but little 
information might be transferred while a user reads the document while it is displayed on the user terminal. Thus, the 
35 information may be passed in short bursts of large amounts of information followed by long periods of small amounts of 
information. 

[0006] Moreover, each of the multiple sources transmitting information might transmit their respective information 
irregularly, with large variations between times of high transmission rates and times of low transmission rates. Thus, sit- 
uations may occur where multiple sources attempt high transmission rates simultaneously. If the instantaneous demand 
40 for information transmission exceeds the bandwidth of the communication medium, not all of the information will be aole 
to be passed through the communication medium at the rate it is being fed to the communication medium. Thus, a tech- 
nique is needed to manage the flow of information through a communication medium and prevent such congestion of 
the medium from interfering with efficient transfer of information. 

[0007] Additionally, it is not always the communication medium that is responsible for creating a bottleneck to effec- 
45 tive communications. In some instances, it is one or more elements of the computing apparatus linked by the commu- 
nication media that causes a bottleneck. For example, some commands instructing computing apparatus to perform 
certain tasks may be very short, but the tasks requested may be very complex and time-consuming. Under such cir- 
cumstances, the command itself is so snort that it will not result in congestion when transmitted over a communication 
medium, but, by instructing the computing apparatus to perform complex tasks, it may overload the caoability of the 
so computing apparatus to process other tasks simultaneously. Thus, a technique is also needed to manage the lead 
placed on the computing apparatus by multiple commands that may ccme from multiple sources. 
[0008] One example of a type of computing apparatus that can easily be instructed to perform complex tasks as a 
result of simple commands is a graphic display, for example, a video monitor or flat panel display. Such displays are 
comprised of large numbers of small image areas, the color and intensity of which may be individually selectively ccn- 
55 trolled. These small image areas are referred to as picture elements, or pixels. The display as a whole is a mosaic of 
pixels used to form characters, symbols, images, or other graphic elements being displayed. However, the process oy 
which the pixels and, consequently, me image being displayed is changed requires time to effect the desired change of 
pixel colors and intensities. Thus, multiple commands instructing multiple simultaneous changes in an image may over- 
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SUMMARY OF THF INVENTION 

[0020] The invention provides a method and apparatus for managing the communication of information. One 
embodiment of the invention allows management of communications comprising a plurality of data streams from a plu- 

5 rality of sources. One embodiment of the invention effectively quantifies and controls data streams comprising data 
transferred at either regular or irregular data rates. One embodiment of the invention provides for estimation of data rate 
needs, measurement and analysis of current and historical data rate parameters, dynamic allocation of available band- 
width, and supports cooperation between data sources and destinations in the management processes. 
[0021] One embodiment of the invention avoids the inequitable reduction of bandwidth for efficient sources using 

w little bandwidth. One embodiment of the invention avoids rewarding sources that unnecessarily request or use large 
amounts of bandwidth. One embodiment of the invention equitably and efficiently allocates available bandwidth among 
sources that provide regular data streams and those that provides irregular data streams. The invention also avoids the 
complexities associated with time division multiplexing. 

[0022] In one embodiment of the invention, data sources generate accurate estimates of bandwidth needs. Based 
75 on these estimates, the data sources generate requests for bandwidth. The data sources send the requests to the 
intended receiver of the data. The receiver orders the requests by amount of estimated bandwidth. The receiver allo- 
cates available bandwidth in the communication medium based on these requests from the data sources and advises 
the sources of their allocations. # 
[0023] While the receiver attempts to allocate each data source its full requested bandwidth, the finite banawioin 
20 limit of the communication medium sometimes prevents such allocation. When the total requested bandwidth exceeds 
the total available bandwidth, the receiver attempts to fully grant the requests of sources that are requesting relatively 
small amounts of bandwidth, while granting reduced allocations of bandwidth to sources that are requesting relatively 
large amounts of bandwidth. This may be accomplished by granting the lowest amounts of bandwidth requests while 
progressing through the ordered list of requests. Once a certain level of bandwidth request is reached, remaining 
25 requests on the list will all have higher requests and may be apportioned/allocated similar bandwidths. 

[0024] Thus, only the sources that require the most bandwidth are affected by the limitation. All other sources are 
unaffected and are granted the full amount of bandwidth they requested. Moreover, by reducing the allocations for only 
sources that require large amounts of bandwidth, a large reduction in allocated bandwidth can be achieved by reducing 
each requested large allocation by only a small percentage. Thus, the average percentage reduction in bandwidth alio- 
30 cations is greatly reduced. . 
[0025] One embodiment of the invention provides a technique for predicting future bandwidth requirements or tne 
sources. The technique utilizes historical information concerning data rates and applies an exponential moving average 
(EM A) method to predict anticipated future data rates. One embodiment of the EMA method incorporates an asymmet- 
ric technique for adapting bandwidth allocations more quickly to increases in data rates than to decreases in data rates. 
35 This asymmetric feature avoids the tendency to unduly decrease allocated bandwidth for a source merely because of 
a temporary lull in the data transmission. The parameters of the EMA method can be selected to provide any desired 
statistical measurement of data rates, for example, a close approximation of the mean plus one standard deviation on 
normally distributed streams of data or sets of bandwidth allocations. 

40 BRIFF DESCRIPTION OF THE DRAWINGS 

[0026] 

Figure 1 is a block diagram illustrating a system comprising multiple data sources according to one embodiment of 
45 the invention. 

Figure 2 is a block diagram illustrating a structure of a data source and a data receiver according to one embodi- 
ment of the invention. 

Figure 3 is a flow diagram illustrating a process performed by a data receiver according to one embodiment of the 
invention. 

Figure 4 is a flow diagram illustrating a process performed by a data source according to one embodiment of the 
invention. 

Figure 5 is a flow diagram illustrating a bandwidth allocation process according to one embodiment of the invention. 
Figure 6 is a flow diagram illustrating a process for allocating bandwidth when the cumulative requested bancwicth 
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exceeds the allocable bandwidth according to one embodiment of the invention. 

Figure 7 is a flow diagram illustrating a process for determining and adjustina bandwidth M h 

embodiment of the invention. aujusnng Dandwidth needs according to one 

Figure 8 is a flow diagram il.ustrating a process for asymmetric tracking of data rate information. 
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other suitable microprocessor or microcomputer may be utiiized. Main memory 1 215 is comprised of dynamic random 
access memory (DRAM). Video memory 1214 is a dual-ported video random access memory. One port of the video 
memory 1214 is coupled to video amplifier 1216. The video amplifier 1216 is used to drive the cathode ray tube (CRT) 
raster monitor 1217. Video amplifier 1216 is well known in the art and may be implemented by any suitable apparatus. 
5 This circuitry converts pixel data stored in video memory 1 21 4 to a raster signal suitable for use by monitor 1217. Mon- 
itor 121 7 is a type of monitor suitable for displaying graphic images. 

[0032] Computer 1200 may also include a communication interface 1220 coupled to bus 1218. Communication 
interface 1220 provides a two-way data communication coupling via a network link 1221 to a local network 1222. For 
example, if communication interface 1220 is an integrated services digital network (ISDN) card or a modem, communi- 
70 cation interface 1220 provides a data communication connection to the corresponding type of telephone line, which 
comprises part of network link 1221. If communication interface 1220 is a local area network (LAN) card, communica- 
tion interface 1220 provides a data communication connection via network link 1221 to a compatible LAN. Wireless 
links are also possible. In any such implementation, communication interface 1220 sends and receives electrical, elec- 
tromagnetic or optical signals which carry digital data streams representing various types of information, 
is [0033] Network link 1221 typically provides data communication through one or more networks to other data 
devices For example, network link 1221 may orovide a connection through local network 1 222 to local server computer 
1223 or to data equipment operated by an Internet Service Frovider (ISP) 1224. ISP 1224 in turn provides data com- 
munication services through the world wide oacket data communication network now commonly referred to as the 
"Internet" 1225 Local network 1222 and Internet 1225 both use electrical, electromagnetic or optical signals which 
20 carry digital data streams. The signals through the various networks and the signals on network link 1221 and througn 
communication interface 1220. which carry the digital data to and from computer 1200. are exemplary forms of earner 
waves transporting the information. 

[0034] Computer 1 200 can send messages and receive data, including program code, through the network(s), net- 
work link 1 221 , and communication interface 1 220. In the Internet example, remote server computer 1 226 might trans- 
25 mit a requested code for an application program through Internet 1225, ISP 1224, local network 1222 and 
communication interface 1220. 

[0035] Tne received cede may be executed by processor 1213 as it is received, and/or stored in mass Siorage 
1 21 2. or other non-volatile storage for later execution. In this manner, computer 1200 may obtain application cede in the 
form of a carrier wave. 

30 [0036] Application code may be embodied in any form of computer program product A computer program product 
comprises a medium configured to store or transport computer readable code, or in which computer readable code may 
be embedded. Some examples of computer program products are CD-ROM disks, ROM cards, floppy disks, magnetic 
tapes, computer hard drives, servers on a network, and carrier waves. 

[0037] The computer systems described above are for purposes of example only. An embodiment of the invention 
35 may be implemented in any type of computer system or programming or processing environment. 

Human Interface Device Computer System 

[0038] The invention also has application to a computer systems where the data to be displayed is provided through 
40 a network. The network can be a local area network, a wide area network, the internet, world wide web, or any other 
suitable network configuration. One embodiment of the invention is used in computer system configuration referred to 
herein as a human interface device computer system. 

[0039] In this system the functionality of the system is partitioned between a display and input device, and data 
sources or services. The display and input device is a human interface device (HID). The partitioning of this system is 
45 such that state and computation functions have been removed from the HID and reside on data sources or services. In 
one embodiment of the invention, one or more services communicate with one or more HIDs through some intercon- 
nect fabric, such as a network. An example of such a system is illustrated in Figure 13. Referring to Figure 13, the sys- 
tem consists of computational service providers 1300 communicating data through interconnect fabric 1301 to HIDs 
1302. 

so [0040] Computational Service Providers - In the HID system, the computational power and state maintenance is 
found in the service providers, or services. The services are not tied to a specific computer, but may be distributed over 
one or more traditional desktop systems such as described in connection with Figure 12, or with traditional servers. One 
computer may have one or more services, or a service may be implemented by one or more computers, i ne service 
provides computation, state, and data to the HIDs and the service is under the control of a common authority or man- 

55 ager. In Figure 13, the services are found on computers 1310, 1311. 1312, 1313, and 1314. 

[0041] Examples of services include Java™ program execution service, X11/Unix services, archived video serv- 
ices, Windows NT service, and others. A sen/ice herein is a process that provides output data and responds to user 
requests and input. 
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by the reduction and the extent of bandwidth reduction (or each affected data source. 

[00531 In one embodiment of the invention, data sources produce estimates of the bandwidth they will likely require 
by monitoring commands being sent to the data receiver. For example, a data source comprising an X w.ndow server 
monitors commands sent to an X window client program. Sy monitoring such commands, the X window server can 
s determine the number of bits and the number of pixels to be transmitted and an ideal period of time over wh.ch sucn 
transmission should occur. By dividing the number of bits by the ideal period of time, the X window server can obtain 
an ideal data rate expressed in bits per second for the data generated by the commands. Likewise, by div,ding the 
number of pixels by the ideal period of time, the X window server can obtain an ideal data rate expressed in pixels per 
second for the data generated by the commands. These ideal data rates can be used as initial estimates of bandwidth 

10 needs. . 

[00S4] As this monitoring and estimation process continues, the historical information concerning the data rates 
can be used to produce statistical parameters descriptive of the data rates. For example, the average data rate or a data 
rate equal to the average data rate plus one standard deviation can be accurately approximated and used to determine 
future bandwidth allocations. . . 

is [00551 The data sources can perform such monitoring, analysis, and estimation of data rate parameters ounng 
periods when they are not transmitting data or. if sufficient computing resources exist at the data sources, during peri- 
ods when they are transmitting data. For example, if a reduction of allocated bandwidth slows the rate at which a data 
source can :ransmit data, the data source may be able to use the time while it waits to transmit the data to perform trie 
monitoring, analysis, and estimation of data rate parameters. 
20 [00561 Figure 1 is a block diagram illustrating a system comprising multiple data sources according to one emooo- 
iment of the invention. The system comprises data receiver 101, communication medium 102. and data source uw. 
104 105 and 106. Data receiver 101 is coupled to data sources 103-1C6 via communication medium 102, whicri is 
capable of passing information at a finite data rate. Each of data sources 103-106 transmits data to data receiver 101 
through communication medium 102. Data sources 103-106 may transmit data regularly or irregularly at constant or 
varying data rates. Data receiver 1 01 is capable of passing information back to any of data sources 1 03-1 06. 
[00571 Figure 2 is a block diagram illustrating a structure of a data source and a data receiver according to one 
embodiment of the invention. The data source comprises human interface 201 and communication interface 202. 
Human inte.faca 201 may be any type of accaratus ror ;r.:a,aoticn v.ith a human, for example, a keyboard, a oisplay a 
mouse or other pointing device, speakers or headchones, a microphone, any other human interface apparatus, or a 
combination thereof. Human interface 201 may also include other input/output devices, for example, a printer, scanner, 
card reader biometric or other sensor, some other input/output device, or a combination thereof. 
[0058] Human interface 201 is coupled to communication interface 202. Communication interface 202 allows com- 
munication between human interface 201 and communication medium 102. Communication interface 201 supports a 
bandwidth limitation capability according to one embodiment of the invention. 

[0059] The data source may comprise a communication interface 203, and, optionally, a database 206, a server 
205 and a client or graphic user interface (GUI) 204. Database 206 stores data. Server 205 allows access to database 
206for storage and retrieval of data therein. Client or GUI 204 utilizes server 204 to store and retrieve data from data- 
base 206. Client or GUI 204 presents data from database 206 is a textual or graphic form for presentation througn 

■to [0060] '"^Cnen^or GUI 204 is coupled to communication interface 203. Communication interface 203 allows commu- 
nication between client or GUI 204 and communication medium 102. Communication interface 203 supports a band- 
width limitation caoability according to one embodiment of the invention. 

[0061] Figure 3 is a flow diagram illustrating a process performed by a data receiver according to one embodiment 
of the invention. The process begins in step 301 . In step 302. the data receiver determines the bandwidth of the eom- 
45 munication medium and the number of data sources that will be transmitting data. In step 303. the data receiver deter- 
mines the average bandwidth allocation for each data source by dividing the bandwidth of the communication medium 
by the number of data sources. In step 304. the data receiver allocates the average bandwidth allocation determined in 
step 303 to each data source. The data receiver informs each data source of its bandwidth allocation. 
[0062] In step 305. the data receiver receives estimates of bandwidth needs from the data sources. In ste P j* 06 ' me 
so data receiver reallocates bandwidth allocations based on the estimates received from the data sources. The aa 
receiver informs each data source of its newly determined bandwidth allocation. From step 306. the process returns ro 

[0063] 05 Figure 4 is a flow diagram illustrating a process performed by a data source according to one embodiment 
of the invention. The orocess begins in step 401. In step 402. the data source monitors command issuance. . or ex 
55 pie the data source can monitor commanas issued by a server to a client or vice versa. h These 

[0064] In step 403, the data source estimates bandwidth needs in bits per second and/or pixels per second, 
estimates are derived from the monitoring of command issuance. The data source calculates the number of bits or pi - 
els that will be generated by a command and the period of time over which they will be generated. By dividing in 
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numcer of bits or pixels by the plft f time, a bits per second or pixels per second val.SR.n™* thp 

statistically combines these values with historica. data for these values to produce s a ^T T n 6 
these statistical va.ues is a set of values representative of the mean plus one EiSJJEI^Z " 
and pixels per second va.ues. These statistica. va.ues are used to produce an estfrna e TbfZ ll h 'V^T 
s per second and pixels per second. estimate of bandwidth needs in both bits 

[0065] in step 404. the data source transmits the estimates of bandwidth needs m * 

data source receives a bandwidth allocation from the data receiver. I Lp 406 t he data t^n ^ 

data .-ate to conform to the bandwidth allocation. rce im,ts ,ts transrn,tted 

[0066] Figure 5 is a flow diagram illustrating a bandwidth allocation process accorr,;™ r„ . w . . 

«» invention. The process begins in step 501 . In steo 502. the data sources LSSS jT embodiment of the 
for bandwidth allocations to a data receiver In steo 503 the data receiver IT. * T * 6dS Se ° d 
width and compares it to the abatable bandwfcS The a oca^.e ^Z^S^^ f 
medium that can be al.ocated for the communication of transmission. For Sample Z ^Z^lTr^ZTT 
may not include additional bandwidth used to faci.itate communication, such aTpacke "jSS^,SSS2Tn ZT 

is amble, cr other overhead. pacKet addressing information, a pre- 

Se 0a« 5 ,?« toT*^?' °' "°" Be CU ™' a " Ve requss,M •»"*«■ »• 

c.iacie pairavram. ir « does, the process com.nues at reference 505. which corresponds to rafarartca. arrs „r Ci„„„ a 

II it doas hot, the process cpnonpes a, srep 506. .» cap 506. Ihe amour,, of b.hdJSh reoua^ad L t d=« ll^ZL 
El e F S'aos 6 ,he 'J£S!£7. d US T" 9 * Pr ° CeSS "" a "° ea " nS b "" MW ' WBe " >" e <="™«« 

the tar bandwidth val,e rn be equal to the amount of una.lccated bandwidth divided by the number of remaining 
requeste Steo 608beainsS d^^'^" bandwidth that may be distributed to all remaining 

S is .1 ^S^S^S^ T the iowest requested bandwidth (orcurrent bandwidth in the orde «* 

caTed the : fa^ bandw^h ?V" ^ Conse ^«n«y, al. remaining requests are allo- 

[00691 I it J de termini » ?* L J™ ^ *' 6 ' ^ Pr ° CeSS '' etUrnS t0 Step 502 of Fi 9"«* 5 via reference 507. 
equeL is J.ocate a sToto aZTV^T * *" than the 1Ur b3ndWidth value - tbe *« a ™ un < of the 

widt A steo 614 thl num!l?'^rf P 2 ' ^ am ° Unt a "° Cated * subtracted f ™ the amount of unal.ocated band- 
Usino such an aoo^ach each r.l Z^ 9 * subt ™ ted ^ one (1 ). and processing continues at step 60S. 

the bandwidth J phoned ?J2 T, V""*" 0nce until the re ^ uest is Sreaterthan the fair bandwidth value Thus, 

zt*xTo£::t::?:z zv:- ose servicss that are takins ,ess than a - fair share - * a » - tbe 

" Say be^ea^eTfor eTch 0 ^^ ■ T ^ ^ StSPS - ^ ° ne or ™ embodiments, step 

the value is ^^^^^T T"" "* 35 l0n9 33 Va,Ue iS ' 6SS than ^ bandwidth va.ue. Once 
alloc! ed am?un te ^£££ErT ' *" Pr6Vi0US "** the fu " amount at «P 61 °' a " 

Sd aTi subSc ed 7 Th S am ° Um ° f aVailaWe bandWidth 31 StSp and the number of requests that 

« m ™=ut?^^^^ — - a " — m U ,tip,e reques. 

ESif 1 0O^TsTa^ Pr0CSSS " 9iVen bS,CW - * 3 — ication medium providing a band- 

" iwrviops is available, and 12 data sources are attempting to transmit 32. 1.2 1 6 4 8 48 1 12 20 4 and 

r a ^rrrdih°; a c^ 3 Mtos * — B ~ » s — ■ i^nia 

50 FIrst - tfle requests are sorted by the amount of requested bandwidth (e.g. 1 1 2 4 4 3 10 12 16 20 32 

Z2::z u :::* z sr idt i is set to the amount cf avanabis bandwi * h ^ ^ - ^ «^ 

00 Mbps a'vSS lS£2r^5 n T Cer ° f reqUSStS (e - 9 ' 12) - A fair bandwidth value is determined by dividing the 

00731 TUX y 1 * ,l data 3Curcas - resuiting in an fair value of 3 33 Mfe p s ° 3r data s °- rce - 

55 3 33 ips It reSe s rfu , anoc, • S " " detefmine * * * ,6SS than 8 " 33 Mb P s " Sin " » * "«« «l« 

ewWM^tan!^ ^ " T am ° Um a " 0Cated (S - 9 - 1 MbpS) is subtra «ed from the total (1 00 Mbps) to 

equests A new M ^TJ^, 0 ' 1 ' S SUbtraCtSd ,rom the remaini "9 re ^ests to leave 1 1 

request of 1 m4s TocllTTT ^ " MbpS/1 1 = 9 MtpS! - ^ 1 ,V,bpS is sti " less than » *"bps. the second 
request of i M.ps ,s allocated the full amount. The process repeats until the value of the request is greater than the fair 
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bandwidth value. When the request with a value of 1 6 Mbps is reached, the fair bandwidth value is 14.5 Mops (58 Mops 
total bandwidth left / 4 requests left). Since there are no data sources requesting more than 1 2 Mbps but less than 1 4.50 
Mbps (as assumed due to the ordering of the requests), ail remaining data sources requesting more than 14.50 Mbps 
are allocated 14.50 Mbps regardless of the actual amount of bandwidth requested by these data sources. Thus, the 
5 total amount of bandwidth allocated to the 12 data sources is 1 + 1 + 2 +• 4 + 4 + 3 + 10 + 12 + 14.5 + 14.5 + 14.5 + 14.5 
= 1 00 Mbps. Therefore, all bandwidth of the communication medium available for allocation has been allocated, but the 
total bandwidth of the communication medium has not been exceeded. 

[0074] One embodiment of the invention allows the application of weightings to the bandwidth estimates of the data 
sources. Such weightings can be used to modify the bandwidth allocation that would otherwise occur without such 

w weightings. For example, if a user perceives what is deemed to be a particularly important data source to be transmit- 
ting data at an unacceptably low data rate because of a low bandwidth allocation, the user can increase the weighting 
of that data source relative to the other data sources in the bandwidth allocation process. This will result in some 
amount of ailocatable bandwidth being redistributed from :he other processes to the one having the higher weighting, 
thereby increasing the data rate at which the more highly weighted process can transmit data. 

is [0075] Likewise, a particular data source deemed to be less important can be given a lower weighting to sacrifice 
some of its allocated bandwidth for the benefit of other more important data sources. Individual weightings can be 
applied to each data source, or a default weighting can be given to all data sources with specific weightings applied to 
particular data sources as desired. The weightings may be applied as factors multiplied by the estimates of bandwidth 
needs for each data source. 

20 [0076] One embodiment of the invention provides for dynamic reallocation of available bandwidth. One manner in 
which dynamic reallocation is provided is that adjustments to allocations previously made to data sources can be made, 
thereby updating the previous allocations and effectively reallocating the available bandwidth of the communication 
medium. 

[0077] Another aspect of the dynamic reallocation of available bandwidth is that bandwidth allocations may be 
25 defined to be valid only for a period of time. For example, allocations may be valid only for a period of time ranging from 
1 mS to 10 seconds, such as a period cf 100 mS. A data source receives a new allocation to allow continued commu- 
nications after the expiration of the previous allocation. 

[0078] Figure 7 is a flow diagram illustrating a process for determining and adjusting bandwidth needs according to 
one embodiment of the invention. Tne process begins in step 701. In step 702, the data source monitors command 

30 issuance. In step 703, the data source calculates numbers of bits and/or pixels that can be expected to result from the 
execution of the monitored commands, in step 704, the data source applies a weighting relative to a previous statistical 
value. For example, if a* is a statistical value such as an average plus one standard deviation, the data source applies 
a weighting x when calculating a new average plus one standard deviation such that a i+1 = (x) a 5 + (1-x) S -^ . Thus, 
a M = a j + (S i+1 -a j)(1/(l -x)) . By selecting the appropriate weighting x, the importance of the new value S i+1 relative to 

35 the previous statistical value a { can be controlled. In step 705, the data source calculates a new statistical value. In step 
706, the data source generates an estimate of bandwidth needs based on the new statistical value. In step 707, the data 
source sends an estimate tc the data receiver. In step 703, tne data source receives a bandwidth allocation from the 
data receiver. In step 709, the data source adjusts its data rate to conform to the bandwidth allocation received from the 
data receiver. 

40 [0079] The weighting as described in Figure 7 may be utilized in allocating bandwidth according to the procedure 
illustrated in Figure 6. For example, each data source's request (r) may be replaced with a value (f) equal to the data 
source's request (r) divided by the data source's weight. The requests may then'be sorted at step 600 from lowest to 
highest based on f. A value S may be calculated as the sum of all weights for the data sources and the remaining 
weight may be set equal to S. Steps 502 and 604 may be performed as illustrated above. Starting with the request with 

45 the lowest r» value (and progressing towards the highest r* value), a fair bandwidth value may be calculated for each 
request at step 606. For example, the fair bandwidth value may be equal to the requested weight divided by the total 
remaining weight (S) multiplied by the total remaining bandwidth: 



(request_weiQht)/(remaining_weight ) * (remain in g_bandwidth) 



50 



At step 608, if the current request is less than the fair bandwidth value, the service request may be allocated the full 
amount of the request at step 810. The allocated bandwidth is subtracted from the unallocated bandwidth at step 612. 
Additionally, the requested weight is subtracted from the remaining weight. However, similar to the procedure without 
weighting, if the current service's request is greater than or equal to the fair bandwidth value, the current request and 
55 all remaining requests are allocated the fair bandwidth value at step 616. Using these calculations and values, if all 
weights are set equal to one, the allocations are similar to the unweighted version. For example, if all weights are equal 
to one, requests are sorted by bandwicth and the fair bandwidth value is one over the remaining number of services 
times the remaining bandwidth. 
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20 



Emited shareS e reso" e ^s One* such T ^ ^ Ca " be applied 10 *• of other 

limited shared resources. One such resource that may ce allocated in such a manner is the processino time of a CPU 

Th,s can oe allocated m terms of cycles per second or percentage of CPU power The proceduresTn FiauT I -™ 
ure 7 would be used by replacing bandwidth with processing power measurement and request- 
[0081 J Figure 1 1 is a drawing of a normal distribution curve illustrating a graphical reoresentation of a statistical 

cS SSTHS 1 n03 m rre P s U enr tn ^ deViaIi ° a NOrma ' «^ "oTl^ZS ™t>S 

curfe no trtca ne W t ™ a <V^ cf the numerica. information represented by norma, distribution 
rnn^i ° 1 T . al '' ne 1 1 04 r2Dre ^nts a value equal to the mean plus one standard deviation 
[0082] Tne area between normal distribution curve 1 101 and baseline 1 102 is divided into th™- r„«. 
three reg ions are region 1 106 representing numerica, information having values feS Zthe me^ va«u7 11oJ Son 

7ZT::!iTuo7r:ZTr having vaiues between mean va,ue 1 103 - STo^s ss 

deviation 1 1 04. «W"tm 8 numerical information having values greater than mean plus one standard 

[0083] If bandwidth needs were estimated based on mean value 1 1 03. there would be a roughly equal chance that 

1 e oTor i o^Tus r ds ,;r fan beiow 1,16 estimate (in region 1 1 ° s > «■ ab °- *• ^7^^^ 

needs suostantially Hke.y that the estimate would be an underestimate of actual bandwidth 

S e "°IT'^t ^J? Tr^ 3 Stand3rd d6Viati0n 1 104 33 3 basis for estimation °< bandwidth needs, 
it iv.ll be very likely that the actual bandw.dth needs will fall below the estimate (in region 1 105 or 1 106) rather than 

^rhlSmVLS? 1 n ThUS ' thS bandWidth reqU6Sted aCCOrdi " 9 to sucn « estimL°U us a^be Ade- 
quate to handle the actual bandwidth needs of the data source. While events in region 1 1 07 will still exceed the esti- 
mate, an estimate farther to the right a.ong norma, distribution curve 1 1 01 would ^LJ^n^^r^Zi 
banaw,dth wh,.e providing benefit only rarely. Thus, the mean plus one standard deviation T 04 P^vfdes ?S £ 
tistical value for efficiently estimating bandwidth needs provides a useful sta- 

25 bee iS in steo 801 8 In ^^^ ,U, *?; nB 3 Pr ° CSSS traCk '' ng ° f data rate info ™ ati °"- ^ P«*~ 

beams n s.eo 801 In step 802, ,he current data rate information is obtained. In step 803, the current data rate informa- 
tion ,s compared to ;ne statical vaiue. .n step 804. a aecision is maoe as to whether or not the current datTrate te 
greater than the statistical value. If so. the process continues in step 805 

[0086] In step 805, a new statistical value is calculated using a first weighting. For example a new statistical value 

step B%iZ S ^o^lT t ^ f °«r g eqUati ° n: a - =*< a > + where SnSt w^ttgt" Rom 

step 305, he process returns to step 802. If. in step 804. the decision is made that the current data rate is not greater 
than the statistical value, the process continues in step 806. In step 806, a new statistical value is calculated usfng a 
second we.ghting. For example a new statistical value can be generated according to the following equation: 
3s rnn^ 2 « , , i+1 ' ? SeC ° nd wei 9 ntina is x 2- Fr °m step 806. the process returns to step 802. 

l TP , V T 9 appr0pr ' ate va,ues for *i and x 2 i" the above equations, a statistical value, such as an approx- 

Z T* ' I -"S °^ a " dard deViati ° n ' ^ Ca,CU,ated - Fur,herm ° r e ' b * se,ec «"9 X 1 < * * a new statistical 
/alue a i+5 /,,! e arfec.ed more ay a new value S i+1 greater than the previous statistical vaiue a, than by a new value 

^^S^^^ST?? VaUje ThUS ' Pr0C6SS Wi " eXhibit 3 " f3St U P' slow down- characteristic in 
which the statistical value will be mfluenced more by peaks in the S values than by lulls in the S values 

"° mTLnsm^ i^lSS ? !? T f^ 0 " °' bandWi ° th M * SUCh behaVi0r Wi " tend to P re ™< dam sources that 
Sh nee* b~ a T of t^ ^ ' U " S b6tWeen the bUrStS from underestimating their future band- 

ied hl t ,', f U H nCe ° f lenQthy bUfStS ° f d3ta in thS SStimation P rocess " n-Sir. the bandwidth 
needed by the data bursts will tend to dominate the estimation calculations. 



45 Concestion Avoidance 



Lblf amount 5 I S , niana 9 ement a »°cates exactly the amount of available bandwidth. If less than the avail- 
■£.TX££2lTr 3 • Una,located bandwidtn wi » be wasted. However, if more than the available 

so the data wiS betLt! ^ that iS attempted t0 06 tran ^itted will actually be transmitted; some of 

L°°!°2 n# th A e n ° ther ( in ; pedin ; ent ; 0 bandwidth management is that occasional bursts of data may occur in 

Tf^Z °lnZT^r h ^V'^ 80 ^ "luitiple data sources, the timing of such occasional bursts of data may 
mit sufh l^Z 'Zf 9S d3ta SCUrC8S - a " CWlnS f ° r the p0SSibiiit V that more tnan °" e da ta source may trans- 
55 medium SSZ^^rTITT^ h '' 3h traffic on the communication 

EST Th t k aft ' C SXC8edS the bandwidtn of ^ communication medium, data will be lost 

H m hi ^!;, a h f n ; qUe : S prCVided for avoidin 9 congestion of the communication medium. This technique bene- 
s ram nign renaouir/ or modem communication media within their available bandwidths. For examole, the incidence 
of data packet loss resulting from electrical interference is typically on the order of lO' 1 *. Thus, the technique utilizes a 
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reasonable assumption that all lost data packets ever a communication medium result from congestion cf the commu- 
nication medium. 

[0092] As discussed above, a data receiver according to one embodiment of the invention allocates the bandwidth 
of the communication medium over which it receives data to assure adequate bandwidth such that it can receive all data 

5 that a set of multiple data sources can transmit Nevertheless, the possibility exists that network switches incorporated 
in the communication medium may drop packets if -heir internal buffers overflow from excessive traffic. Furthermore, 
although a data receiver has allocated resources to provide the designated amount of aggregate bandwidth over a 
period, bursts of data from multiple data sources may arrive essentially simultaneously, thereby overloading the data 
receiver's buffers and resulting in lost data packets. Additionally, congestion may result when a data source does not 

w immediately recognize that its bandwidth allocation was cut before it sent a large number of commands or a large 
amount of data. 

[0093] In any event, a data source can rely on the reasonable assumption that data losses are caused by conges- 
tion. If the data source responds to the detection of data losses by blindly sending error corrections at that point at the 
full data rate allocated to it, the congestion will likely be exacerbated. 
15 [0094] Thus, one embodiment of the invention provides a congestion avoidance technique. According to one 
embodiment of this technique, a data source voluntarily limits its bandwidth use to an amount less than that allocated 
to it until the congestion situation improves. One example of a data source to which the present invention may be 
applied is a remote display device. 

[0095] Figures 9A, 9B, and 9C are a flow diagram illustrating a process for congestion avoidance according to one 
20 embodiment of the invention. The process begins in step 901 and continues to step 902. In step 902, a data source lim- 
its the amount of bandwidth it is actually using to the smaller of the amount of bandwidth that has been allocated to it 
and a voluntary limit established by the data source itself. The smaller of the amount of allocated bandwidth and the 
voluntary limit is referred to as the congestion avoidance bandwidth limit. 

[0096] In step 903, a decision is made as to whether or not a data error has been detected since the last time the 
25 process was at step 903. If not, the process continues to step 922. In step 922, a decision is made as to whether or not 
the bandwidth needs have increased. If so, the process continues to step SOS via reference 910. If not, the process 
returns to step 9C2. However, if in step 9C3 a data error has been detected, the process continues to step 904, where 
a slow-start bandwidth threshold and a siow-growth bandwidth threshold are calculated, a bandwidth increment value 
and a voluntary limit are defined, and the congestion avoidance bandwidth limit is recalculated. For example, the slow- 
30 start bandwidth threshold may be set to be some fraction of the current congestion avoidance bandwidth limit As an 
example, this fraction may be in the range cf 0.1 to 0.8, such as 0.5 of the current congestion avoidance bandwidth limit. 
[0097] The slow-growth bandwidth threshold may, for example, be set to some fraction of the current congestion 
avoidance bandwidth limit As an example, this fraction may be in the range of 0.2 to 0.9, such as 0.75 of the current 
congestion avoidance bandwidth limit The bandwidth increment value may be set to some fraction of the current con- 
35 gestion avoidance bandwidth limit. As an example, this fraction may be in the range of 0.005 to 0.3, such as 0.03125 of 
the current congestion avoidance bandwidth limit. The voluntary limit may be set to some fraction of the current con- 
gestion avoidance bandwidth limit. As an example, this fraction may be in the range of 0.005 to 0.9, such as 0.0625 of 
the current congestion avoidance bandwidth limit 

[0098] In step 905, a bandwidth check time is scheduled in the future. For example, the bandwidth check time may 
40 be scheduled for a period from 5 to 500 mS, such as 50 mS, in the future. From step 905, the process continues to step 
907 via reference 906. In step 907, a decision is made as to whether or not the bandwidth check time has passed. If 
not, the process returns to step 907. If, however, the bandwidth check time has passed, the process continues to step 
908. 

[0099] in step 908, a decision is made as to whether or not additional data errors have been detected. If additional 
45 data errors have been detected, the process continues to step 909. In step 909, a decision is made as to whether or 
not additional errors occurred within a given period of time. For example, this given period of time may be a period of 
time between 50 mS and 5 seconds, such as 500 mS. If additional errors occurred within the given period of time, the 
process returns to step 905 via reference 910. If not, the process returns to step 904 via reference 911 . if, in step 908, 
no additional errors have been detected, the process continues to step 912. 
50 [0100] In step 912, a decision is made as to whether or not the voluntary limit is less than the allocated bandwidth, 
if not, the process returns to step 902 via reference 913. If, however, the voluntary limit is less than the allocated band- 
width, the process continues to step 914. In step 914, a decision is made as to whether or net the voluntary limit is less 
than the slow-start bandwidth threshold, if not, the process continues to step 913 via reference 915. 
[0101] In step 918, the value of the voluntary limit is increased by the amount of the bandwidth increment value. 
55 From step 918, the process continues to step 919. 

[0102] If in step 914, the voluntary limt is less than the slow-start bandwidth threshold, the process continues to 
step 916. In step 916, the voluntary limit :s substantially increased. For example, the voluntary limit may be increased 
by multiplying it by a given factor. For example, if a given factor such as two is used, the voluntary limit is doubled in step 
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T^TsTr^Z^T' ^ 10 ^ ranSe « 10 - ^ be US6d - ^ *» P—ss contin.es 

Shr-shcidlf sTa ^SS c^r " * ""^ °' ** * ™ *™ «• ^^wth band- 

am. int0 the future atwhich the bandwidth check time is scheduled in step 919 mafbe " 2 ?~ 2 iS^X, ™ 
seconds, such as one second into the future. From steo 920. the process continuTs to Jin ? 0 - 9 , an* 
[0104] „. in St ep 9,9. the voluntary limit is not above the slow-growth banSh Z , 
■n step 921 . ,n step 921 . the data source limits the amount of bandwidth * is SlTuSi to t * 2 
bandwidth limit. From step 92, . the process returns to step 905 via reference 9i 0 9 COn 9 est,on avo,dance 

h°It° if' ^aZZ^Z^T?^ aCCOrdin9 10 °" e embodim - 1 **. invention adheres to a principle 
allow mTS^^^S^^^^ *• T S °: rce ,0 remai " relative 'V <°' -me^me'o 
data source .fretum to a tv^ ST? , P P ' S a9ai " St the Drinciple that ]t is important for the 

h.gher fract.on of .« -cme, va.ue tn e data rate is increased even more slowly. This p^tSc^ZTXS 

2/2? de!e "' ne " ^ ,e " /el ° f thS f ° rmer d3ta rate COntributed to the da < terror that Ss dLS .f as The 
data rate .s mcreaseo rcwam ,ts fonder level, additional error are detected, the data rate is agin reduced and i? U a lv 
increased to reouce aoat.ona congestion. Otherwise, if no further data errors are expe fenced £^^ii££2 
the amount of ban****, used by me data source to the full amount of bandwidth JLJS^dSSS^^ 

Son ^p^^r^SS ° f T C ° nSeSti0n aV ° idanCe teChniqUe ^ fto 0- -bo d ren, of the 

r7a*Z hig S «.^«o ,"(£ h 3 C ° nt,nUeS " 1 °° 2 - StSP 1 °° 2 ' a data source transmits data « a 
relatively m 3 n data rate in step , 003. a decision is made as to whether or not a data error is detected If no data error 

. IIZ^^JS^^ 1 T * h ° Wever ' 3 data errar is detscted ' the P^^«?«?m 

m siep 1 uu4, trie aata source drastically reduces its data rate immediately 

EfcnL vLluf' la ata e'onlVr"^ 6 "^ * ^ itS ^ *«* t0 Some fracti ° n - f0 ' example half, of 

006 T stec 1006 STJ aed ' thS Pr ° CSSS retUrnS t0 Step 1004 - O^erwise. the process continues to steo 
^v ^^ZTvTTZZT*" X ° re ' atiVely S ' 0W,y inCr8aSe itS ^ fate 10 SOme h '9her fraction of its 
- SZ„«??«ST5? 3rr ° r ,S d6teCtedl PrCCSSS retUmS 10 Step ,0C4 ' * a P-ess 

ITdth i I locatVd t to^h C e 0 d 7 at , a h so'ut ^ * ^ m0 ~ S, ° W,y inCre3Se itS data rate to the ful. amount of band- 

width allocated to the data source. From step 1007, the process returns to step 1002 

described i^niu^on°wi'h on PParatUS *" man ^ Sment of communications over media of finite bandwidth has been 
<o scope ofec^Snts " embodiments - The Mention is defined by the claims and their ful. 

[0111] The features disclosed in the foregoing description, in the claims and/orin the accompanying drawings mav 
both separately and ,n any combination thereof, be material for realising the invention in diverse Z^heTeoT 
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Claims 

1 . A method comprising the steps of: 

receiving estimates of bandwidth needs from a plurality of data sources* 
sortirtg said estimates of bandwidth needs; 

^aversing said sorted estimates of bandwidth needs and performing the following for at least one of said es:i- 
obtaining a fair bandwidth value; 

t>Z^ n,ng ? T id 6StirTlate ° f bandwidtn n eed is less than said fair bandwidth value; and 

value 9 3 am ° Um °' S3id eStimate ° f bandwidth need if said "eed is less than said fair bandwidth 

2. The method of claim 1 further comprising allocating said fair bandwidth value to all remaining estimates if said need 
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is greater than or equal to said fair bandwidth value. 

3. The method of claim 1 wherein said fair bandwidth value is the amount of unallocated bandwidth divided by a 
number of remaining estimates. 

4. The method of claim.! wherein said estimates of bandwidth needs are sorted from lowest to highest bandwidth. 

5. The method of claim 1 wherein each estimate of bandwidth need is sorted by said estimate divided by a data 
source's weight 

6. The method of claim 5 wherein said fair bandwidth value is equal to said data source's weight divided by a remain- 
ing weight multiplied by remaining bandwidth. 

7. A system comprising: 

one or more data sources configured to transmit estimates of bandwidth needs; 
a data receiver configured to: 

sort said estimates of bandwidth needs; 
2Q for at least one of said estimates of bandwidth needs, 

obtain a fair bandwidth value; 

determine if said estimate of bandwidth need is less than said fair bandwidth value; and 
allocate a full amount of said estimate of bandwidth need if said need is less than said fair bandwidth 
25 value. 

8. The system of claim 7 wherein said data receiver Is further configured to allocate said fair bandwidth value to all 
remaining estimates if said need is greater than or equal to said fair bandwidth vaiue. 

30 9. The system of claim 7 wherein said fair bandwidth value is the amount of unallocated bandwidth divided by a- 
number of remaining estimates. 

10. The system of claim 7 wherein said estimates are sorted from lowest to highest bandwidth. 

35 11. The system of claim 7 wherein each estimate of bandwidth need is sorted by said estimate divided by a data 
source's weight 

1 2. The system of claim 1 1 wherein said fair bandwidth value is equal to said data source's weight divided by a remain- 
ing weight multiplied by remaining bandwidth. 

40 

13. A computer program product comprising: 

a computer usable medium having computer readable program code embodied therein configured to allocate 
bandwidth, said computer program product comprising: 

45 computer readable program code configured to cause a computer to obtain estimates of bandwidth needs tram 

a plurality of data sources; nfl aric , 

computer readable program code configured to cause a computer to sort said estimates of bandwidth neeas 
computer readable program code configured to cause a computer to obtain a fair bandwidth value for at least 
one estimate of bandwidth need; . nHu/irith 

so computer readable program code configured to cause a computer to determine if said estimate of Danowiom 

need is less than said fair bandwidth value; and 

computer readable program code configured to cause a computer to allocate a full amount of said estimate ot 
bandwidth need if said need is less than said fair bandwidth value. 

55 14. The computer program product of claim 13 further comprising computer readable program code configured to 
cause a computer to allocate said fair bandwidth value to all remaining estimates if said need is greater tnan 
equal to said fair bandwidth value. 
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